Receiver operating characteristic (ROC) analysis Evaluating discriminance effects among decision support systems
نویسنده
چکیده
An overview of the usage of Receiver Operating Characteristic (ROC) analysis within medicine and computer science is given. A survey of the theory behind the analysis is given together with a presentation of how to create the ROC curve and different methods to interpret it. Both methods that rely on binormal distributions and methods that rely on distribution free methods have been mentioned. A way to better know the quality of the measurements of sensitivity and specificity is presented. The quality measures and the QROC curve as is also included together with a discussion about optimal cut-offs and the connection to Bayesian decision theory. Results from earlier experiments and case studies will be used to exemplify the use of the ROC and QROC curves.
منابع مشابه
The use of receiver operating characteristic curves in biomedical informatics
Receiver operating characteristic (ROC) curves are frequently used in biomedical informatics research to evaluate classification and prediction models for decision support, diagnosis, and prognosis. ROC analysis investigates the accuracy of a model's ability to separate positive from negative cases (such as predicting the presence or absence of disease), and the results are independent of the p...
متن کاملReceiver Operating Characteristic (ROC) Curve Analysis: A Tutorial Using Body Mass Index (BMI) as a Measure of Obesity
The purpose of this tutorial-based lecture is to show the usefulness of performing a receiver operating characteristic (ROC) curve analysis. The lecture will explain the background terminology associated with a ROC curve analysis, show the necessary SAS software coding to run a ROC curve analysis, and finally help interpret the analysis output in order to make informed research decisions. An ex...
متن کاملAn introduction to ROC analysis and its applications
In this chapter we give an introduction to ROC (receiver operating characteristics) analysis and its applications to data mining. We argue that ROC analysis provides decision support for data mining in several ways. For model selection, ROC analysis establishes a method to determine the optimal model once the operating characteristics for the model deployment context are known. We also show h...
متن کاملReceiver Operating Characteristic (ROC) Curve Analysis for Medical Diagnostic Test Evaluation
This review provides the basic principle and rational for ROC analysis of rating and continuous diagnostic test results versus a gold standard. Derived indexes of accuracy, in particular area under the curve (AUC) has a meaningful interpretation for disease classification from healthy subjects. The methods of estimate of AUC and its testing in single diagnostic test and also comparative studies...
متن کاملAnomaly Detection Using SVM as Classifier and Decision Tree for Optimizing Feature Vectors
Abstract- With the advancement and development of computer network technologies, the way for intruders has become smoother; therefore, to detect threats and attacks, the importance of intrusion detection systems (IDS) as one of the key elements of security is increasing. One of the challenges of intrusion detection systems is managing of the large amount of network traffic features. Removing un...
متن کامل